Bayesian Posteriors Without Bayes' Theorem
نویسندگان
چکیده
The classical Bayesian posterior arises naturally as the unique solution of several different optimization problems, without the necessity of interpreting data as conditional probabilities and then using Bayes' Theorem. For example, the classical Bayesian posterior is the unique posterior that minimizes the loss of Shannon information in combining the prior and the likelihood distributions. These results, direct corollaries of recent results about conflations of probability distributions, reinforce the use of Bayesian posteriors, and may help partially reconcile some of the differences between classical and Bayesian statistics.
منابع مشابه
Beyond Bayes
The Geometric Theory of Ignorance produces posterior distributions from priors and likelihoods without invoking Bayes Theorem at all. The standard bayesian posteriors minimize the ignorance action with parameters δ = ν = 0 when the truth t is replaced by the empirical distribution of n independent observations. Different values for the parameters produce new ways for processing the data obtaini...
متن کاملFrequentist Consistency of Variational Bayes
A key challenge for modern Bayesian statistics is how to perform scalable inference of posterior distributions. To address this challenge, variational Bayes (vb) methods have emerged as a popular alternative to the classical Markov chain Monte Carlo (mcmc) methods. vb methods tend to be faster while achieving comparable predictive performance. However, there are few theoretical results around v...
متن کاملTHE EMPIRICAL BAYES METHOD OF ANALYSIS OF A SERIES OF EXPERIMENTS
The classical method of analysis of a series of experiments is somewhat involved in being conditional on various, occasionally unrealistic, assumptions such as homogeneity of variances of experimental error, lack of interactions of treatments and places,etc. In this work, we adopt a Bayesian view to account for such heterogeneities. Our appoach is illustrated by a real series of experiment...
متن کاملGroup invariant inferred distributions via noncommutative probability
Abstract: One may consider three types of statistical inference: Bayesian, frequentist, and group invariance-based. The focus here is on the last method. We consider the Poisson and binomial distributions in detail to illustrate a group invariance method for constructing inferred distributions on parameter spaces given observed results. These inferred distributions are obtained without using Ba...
متن کاملBayes Theorem for Improper Priors
Improper priors are used frequently, but often formally and without reference to a sound theoretical basis. A consequence is the occurrence of seemingly paradoxical results. The most famous example is perhaps given by the marginalization paradoxes presented by Stone and Dawid (1972). It is demonstrated here that the seemingly paradoxical results are removed by a more careful formulation of the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1203.0251 شماره
صفحات -
تاریخ انتشار 2012